Microscopic expression of the second law of thermodynamics 

Takaaki MonnaEI 
^Department of Applied Physics, Osaka City University, 
3-3-138 Sugimoto, Suniiyoshi-ku, Osaka 558-8585, Japan 

We give an explanation of the second law for macroscopic quantum systems under the assumption 
that the initial state is described by a canonical ensemble. We formally derive the positivity of the 
nonequilibrium entropy difference. Then it is shown that the nonequilibrium entropy difference 
can be regarded as the entropy difference in thermodynamics for typical relaxation processes of 
macroscopic quantum systems. 
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Since the pioneering work by L.Boltzmann, considerable attentions have been paid to the microscopic derivation 
I— I of the second lavif of thermodynamics as shovifn in many literatures such as Ref. Ij. These seminal works explain 
i-^ the relaxation to the equilibrium as a tendency toward "the most probable state" . The relaxation processes are 

irreversible as expressed by the so-called H-theorem based on the kinetic entropy. However, the microscopic time 
C/^ I reversibility and Poincare recurrences [1] raised crucial criticisms to such probabilistic interpretations, i.e., the entropy 









I. INTRODUCTION 



can not monotonically increase in the course of time evolution. In order to avoid recurrent behaviors, infinitely large 
reservoirs are often employed^, Q so that the recurrence time goes to infinity. However the assumption of infinite 
reservoirs would be unrealistic and excludes framework based on the partition function 3]. On the other hand, it 
Y^ \ is remarkable that even for finite quantum systems, there is a well-defined non-negative entropy production which 
.^H ' expresses a correlation between the subsystem and finite reservoirs as a relative entropy [J]. 
Z? \ In this article, we straightforwardly derive a microscopic expression of the second law of thermodynamics for macro- 

^H ^i scopic quantum systems by taking into account for the relaxation to a canonical state in the evaluation of expectation 
Oj' values |9]. By assuming the phenomenological law of relaxation property which is verified for the expectation value 
of macroscopic quantities, we reveal the microscopic expression of the entropy increase. It is shown that the entropy 



diff'erence between the initial and final states is expressed as a relative entropy which measures a lag between the 
actual final state and approximate canonical state. 

II. SECOND LAW OF THERMODYNAMICS 
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l/~) • Let us consider a macroscopically large but finite initially isolated system. The initially isolated system is typically 

^^ ■ composed of a subsystem and a reservoir. After initial time t — Q, there is an external forcing acting on the system, 

^D , and the total Hamiltonian H{t) depends on time. Until i = 0, the density matrix describing the initial state is 

' ' assumed to be canonical 



,(0, . ^.-»..., ,1) 

where /3 = -rp-™ is the inverse of the temperature T, fcs is the Boltzmann constant, and Z{G) is the partition function 
determined from the normalization, respectively. In order to avoid confusion, it is pointed out that the canonical 
ensemble can describe the isolated systems as well as open systems, i.e. the density of energies has an extremely sharp 
peak and the canonical ensemble is practically yields the same value as the corresponding microcanonical ensemble. 
The use of canonical ensemble is reasonable especially for the case that the total system is composed of a subsystem 
and a large reservoir. In the course of time evolution, the external work is done on the system through the time 
dependence of H{t). 

The deterministic external forcing acts during the time interval < ^ < To, and switched off for i > Tq. It 
is expected that after a sufficiently long waiting time, i.e. at t = T 3> Tq, the density matrix reaches a state 
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which yields approximately same expectation values as the canonical ensemble p{T) ~ 'zTT)^ PH(t) ^^ ^^ inverse 
temperature /3 = t^- Note that even when the actual state does not relax to equilibrium, p{T) and corresponding 

partition function are well-defined. Further microscopic justification of the assumption is described below Eq.(8). 

Then we calculate the entropy difference AS between the initial and final equilibrium states. Here according to the 
statistical mechanics, the entropy is regarded as the logarithm of the number of the states Vt{E{s))5E which have a 
constant energy E{s) (s = 0,7") with a small uncertainity 5E <^ E{s). First, we give an expression of the entropy 
difference. As the equilibrium statistical mechanics, let us define the entropy at t = T as 

^ ^ Tr{U p{0)U+pHiT)+ log Z{T)} 

= ${{H{T))-F{T)), (2) 

where F(T) = — ■ilogZ(T') is the free energy at time T. F{T) is specified by the temperature /3 and Hamiltonian 
H{T). 

U = T{e-y^J'^'^*"^'^ (3) 

is the unitary time evolution operator expressed by the time-ordered product. Therefore, we can rewrite the entropy 
difference 

AS = S{T)-S{0) (4) 

as a relative entropy between the actual final state C/p(0)C/+ and the canonical state p{T) 

AS 

= (Tr{(7p(0)C/+/3i/(T)} - PF{T)) - (Tr{p(0)/3i?(0)} - /3F(0)) 

= -Tr{C/p(0)f/+ {\ogp{T)-\ogUp{Q)U+)) 

= D[Up{m^\\p{T)] 

> 0, (5) 

which is by definition non- negative [J, |6|. Note that AS is a thermodynamic entropy difference only when the state 
Up{0)U~^ is an equilibrium state. Remarkably, the entropy change describes how actual and equilibrium states are 
different. This is one of the results of this article. 

Below we evaluate the typical value of AS*. As shown in Ref.pjj we can derive a thermalization of the expectation 
value of an observable A which polynomially depends on the system size 

TtUp{0)U+A ^ Tipi T)A. (6) 

The actual state Up{0)U^ and the equilibrium state p{T) are close in such a way. In order to estimate the accuracy 
of the approximation, we outline the derivation [5]. The actual final state is reached by a unitary time evolution 

Up{0)U+ 

= e-i"iT){T-To)plj^^^iH{T){T-To) 

= ^c„,,„|£;„)(S™|, (7) 

where c„,^ = e-i'-^--^'^^^^-^'>^Er,\U{To)p{Q)U{To)+\E^), and U{To) = Tje-Zo"''' *^(*)'^*}. After Tq, the total 
system is isolated, and evolves by the Hamiltonian H{T). On the other hand, the off-diagonal elements of physical 
quantity A is negligible compared to the diagonal elements: 

i) The off-diagonal matrix element {En\A\Em) is typically negligible in the macroscopic limit. Physically, this 
would mean that transition amplitudes between macroscopically different states due to the perturbation A are 
extremely small. We shall give a quantitative explanation of this statement. Let us diagonalize the quantity A 
as 



A = ^A„|A„)(A„|, (8) 



and define its square root 

i? = vyi;i^„)(A„|. (9) 



We also define state vectors {|$n) ~ B\En)} so that the matrix element is expressed as the inner product 

{E„\A\Ern) = ($„|$,n>. (10) 

The states (I'&n)} are chosen from the extremely large Hilbert space H with various directions. Thus we assume 
that the sequence of the normalized vectors i , , ...| is regarded as a uniformly random samplinq 

from AvoyH dimensional unit sphere. It is then straightforward to show that the mean square of the inner product 
is smaller than ^^ JL [j , which we will show later. Here ||^|| is the maximum of the eigenvalues of A. 
Let us derive the inequality for the inner product 

(l(*n|$™>P)<|^, (11) 

where the bracket shows the average with respect to the uniform random sampling of , "' from the 

unit sphere. In Eg. dill) . \\A\\ polynomially depends on the system size. On the other hand, the di- 
mension dvavH grows exponentially as the system size increases. Then inequality pTJ) shows that the 
off-diagonal elements Ea.([T^ is extremely small for the macroscopic system. In order to derive the in- 
equality (jlll) . we introduce the vector representation of . ' "^ in a orthogonal complete basis as dn = 

(cos 01, sin 01 cos 02, sin 01 sin 02 cos 03, ..., sin ^1 sin 02 • • • sin0d-i) with d = dimH. Without loss of generality, 
another vector can be fixed at dm — (1, 0, 0, ..., 0). The square inner product is then calculated as 



($„|$„)(*m|*m) 

/^^^ ^" ^2\ AT [^ P 2fl |5(''cos0i,...,rsin0i •• •sin0rf_i)| 

{[dn-dm))^N •••/ COS 01 -— \ d0i---ded- 

Jo Jo d(0i,...,0rf_i,r) "^-^ 

= N I ■I (1 - sin^ 0i) sin'*"^ 0i sin''"^ 02 • • • sin 0^-2^01 • • • d9d- 



1 



10 Jo 



(rf-2)r(^)r(^. 



r(^) r{l)d 



1 
d' 



(12) 

where A'^ = Iln^i r( ^+^^ ^ ^^ ^^^ normalization factor. Since |_E.„) and \Em) arc normalized, 

($„|$„)($™|-I>™) 
= {En\A\E„){Em\A\E.m) 
< WAf. (13) 

The inequality ([TT1) derives from Eqs. (|12|13p . From Eq.(fTT|). the coefficient Cn,m of Eq.© is safely replaced 
by {En\U p{Q)U^\Em)Sn,m in the evaluation of Tr[/p(0)C/+A. More quantitatively, the contribution from the 
off-diagonal elements is evaluated as 

d 



Y, {En\Up{0)U+\Em){Em\A\E„) 



n^m 



d 



lp(o)IIPIIf^ ,^, 



Vd ^/d 



^e^^-, (14) 



where (pnm is the phase for the nm matrix element. If the quantities Up{Q)U~^ and A are completely uncorrelated, 
then we have 

d 
^e'^-=0(d), (15) 

and Eq. (fT4|l is ||p(0)|| ||^||. Since ||p(0)|| = ^ from the normalization, and the off-diagonal contribution is indeed 
negligible. 



ii) It is remarked that the canonical distribution given in Eq.([T]) is highly degenerated at an energy E for macroscopic 

i{E-H(0) 
f2(S(0)) 

I .,0 

n{E{0)) 



systems, and therefore practically equivalent to the microcanonical ensemble q(e(o)) ■ Therefore we first 
concern with the microcanonical ensemble, i.e. we replace p(0) with — ^-^ 






Then the diagonal element is expressed as 

Pi 

-{E,,\5{UH{Q)U+-E)\E, 



{E^\Up{Q)U+\Er, 
1 



n{Em 

= ^^^T.^^Era^^)-E)\{En\U\E^{m\ (17) 

where we introduced the normalized eigenstates of H{0) as if(0)|-E„) = En\En). In the relaxation process, 
\{En\U\Era{0))\'^ would be non negligible only when the conservation of the energy is well-satisfied after the 
long waiting time, i.e. En = £'m(0) -I- AE with an energy change AE from the initial to final times caused by 
external perturbation during < t < To . The validity of Eq. ()18p depends on how accurately the conservation of 
energy (i?„j|[/|£'„(0)) = 0(i?,„ 7^ E„{0) + AE) holds. The third line of Eq.dlTl) behaves as a function of E„ as 

{E,,\Up{0)U+\E,,) 

= , , ,J iEn -E- AE) 
n{E{T)) ^ ' 

= ^^" ' n{E{T)) ^^"^^^ " ^ " Aii;) |i?„) 

- (^«l^e-'^«(^)|i?„), (18) 

where the density of the states at t = T is determined uniquely from the normalization of Eg. (1171) . H{T)\En) = 
En\En) is used, and we replaced the microcanonical ensemble by the corresponding canonical ensemble whose 
density of the states has a sharp peak at £' + AE. 

The relaxation property is also necessary for the thermodynamic quantities such as free energy difference considered 
in the nonequilibrium theorems to make sense[8|,|9|. 

III. ENTROPY DIFFERENCE 

We estimate AS* = D[U p{Q)U^\\p{T)] based on the Eas. (|6ll8p . As a physical quantity A, we substitute A = 
log p{T). Then Eq.® shows that 

Tr[/p(0)t/+log/9(r) ^ Trp(T)log/9(T). (19) 

And the entropy difference is calculated as 

AS ^ -Trp( T) log p{ T) + Trp(O) log p(0) 
= Ttp{T)H{T) -Ttp{0)H{0) - AF 

= ASeq. (20) 



IV. DISCUSSION 

In conclusion, by assuming that the initial state is described by canonical ensembles, we have derived an ex- 
pression of the nonequilibrium entropy difference. We also revealed that the nonequilibrium entropy difference is 
well-approximated by the equilibrium entropy difference for typical state of macroscopic quantum systems. In this 
way, the entropy increases for typical processes. 

V. ACKNOWLEDGMENT 

The author is grateful to Professor A.Sugita for fruitful discussions. This work is financially supported by JSPS 
research fellowship for young scientists under the Grant in aid 22-7744. 



[1] 
[2] 
[3] 
[4] 
[5] 
[6] 
[7] 
[8] 
[9] 
[10] 

[11] 



R.Zwanzig, Nonequilibrium statistical mechanics, Oxford New York (2001) 

E.Karpov, G.Ordonez, T.Petrosky, and I.Prigogine, Phys. Rev. A 66, 012109 (2002) 

S.Tasaki, and T.Matsui, Fundamental Aspects of Quantum, Physics eds. L. Accardi, S. Tasaki, World Scientific 100 (2003) 

M.Esposito, K.Lindenberg, and C.Van den Broeck, New Journal of Physics 12 013013 (2010) 

T.Monnai, Phys.Rev.E, 84 011126 (2011) 

W.Thirring, Quantum Mathematical Physics, Springer Second Edition (2002) 

S.Goldstein, J.L.Lebowitz, R.TumuIka, and N.Zanghi, Phys.Rcv.Lctt.96 050403 (2006) 

C. Jarzynski, J. Stat. Phys. 98 77 (2000) 

C.Jarzynski, Phys.Rev.Lett.78 2690 (1997); Phys.Rev.E 56 5018 (1997) 

D.J. Evans, E.G.D. Cohen and G.P. Morriss, Phys. Rev. Lett. 71 2401 (1993) 

G. Gallavotti and E.G.D. Cohen Phys. Rev. Lett. 74 2694 (1995); E.G.D. Cohen and G. GaIlavotti,J.Stat.Phys.96 1343 

(1999) 



